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SECTION  1 


INTRODUCTION 


The  goal  of  this  ongoing  project  le  to  develop  end  to  validate  a  mathe¬ 
matical  aodel  of  a  Naval  rnamsnilnr  *■  decisionmaking  process.  This  process  is 


comprised  of  planning,  organising,  and  executing  a  given  mission  (1].* 

A  model  of  a  commander  servos  two  purposes.  They  are;  (1)  to  diagnose, 
or  to  Identify,  the  commander's  cognitive  limitations  that  render  him  boundedly 
rational,  and  accordingly  suggest  decision  aids  or  support  systems  that  will 
enhance  his  performance,  and  (2)  to  appraise  the  effectiveness  of  such  improve¬ 
ments  in  the  command  and  control  (C2)  network,  in  which  the  commander  is  but 
one  element. 


1.1  METHODOLOGICAL  FRAMEWORK 

Models  of  human  decisionmaking  are  often  classified  into  three  catego¬ 
ries  :  normative  models,  descriptive  models  and  normative-descriptive  models. 
Normative  models,  by  definition,  prescribe  how  decisions  should  be  made  when 
the  decisionmaker's  objectives  are  explicit  [2;3].  Models  that  mimic  human 
decisionmaking  behavior,  in  a  non-humanoid  way,  are  descriptive.  These 
models  are  used  when  decisions  are  repeatable,  and  are  often  referred  to  as 
"bootstrapping”  models  [4].  Normative-descriptive  models  assume  that  the 
decisionmaker  strives  to  be  optimal,  but  is  constrained  by  cognitive  and,  to 


^References  are  indicated  by  numbers  in  brackets,  and  appear  st  the  end  of 
the  report. 
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a  lesser  extent,  neuromotor  limitations.  The  normative-descriptive  approach 
la  employed  herein. 

1.2  HUMAN  DECISIONMAKING 

A  paradigm  for  the  process  of  human  decisionmaking  has  been  conceptu¬ 
alised  by  Wohl  [1].  Vohl  generlcally  describes  the  decisionmaking  process  as 
a  cascading  of  four  activities.  They  are: 

1.  Information  processing. 

2.  Hypothesis  generation  and  evaluation. 

3.  Option  generation  and  evaluation. 

4.  Execution. 

He  has  coined  this  paradigm  SliOR  (stimulus-hypothesis-option-response) ,  since 
it  la  an  extension  of  the  stimulus-response  (S-R)  paradigm  of  classical  behav¬ 
ioral  psychology  [5].  SHOR  is  a  framework  for  structuring  decision  problems. 
It  is  not  an  analytical  model.  When  referring  to  a  SHOR  model,  what  is  im¬ 
plied  is  a  model  that  has  been  devised  within  the  SHOR  framework. 

In  this  report,  the  commander's  decisionmaking  process  is  ca3t  in  the 
SHOR  framework,  and  a  model  for  hypothesis  evaluation  is  proposed.  The  hy- 
pothesJ*  evaluation  technique  is  normative  in  construct.  It  closely  parallels 
the  cc.i<.rol  and  estimation  theoretic  [6)  approach  to  hypothesis  testing.  The 
sufficient  information  for  option  generation  and  evaluation  is  suggested. 

1.3  COMMAND  AND  CONTROL 

Throughout  this  report,  reference  is  made  to  the  C2  process  and  the  com¬ 
mand,  control,  and  communication  (C3)  system.  Various  groups  and  individuals 
have  imbued  these  terms  with  somewhat  different  meanings.  Thus,  it  behooves 
us  tc  define  what  we  are  referring  to  by  the  C2  process  and  the  C3  system. 
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The  C2  process  Is  a  coordinated  lit  o*  information  gathering  and  deci- 
■ionmaking  activitiaa,  carried  out  with  th«  obj active  of  affactiva  fore#  ap¬ 
plication,  l.a.,  tha  bait  utllliatlon  of  platforms  and  weapons  in  tha  battle 
environment.  Tha  C2  procaaa  la  aupportad  by  the  C5  lyataa.  Tha  Cs  system  la 
a  collection  of  sensor,  information  proceeding,  and  communication  aubiyatama 
that  allowi  tha  C2  urganieation,  which  it  comprised  of  military  personnel 
operating  within  a  hierarchical  authority  structure,  to  receive  information 
from  and  tranemit  information  about  the  battle  environment,  facilitating  in¬ 
formation  Interchange  between  the  members  of  the  C2  organisation. 

The  C2  process  thus  involves  a  collection  of  human  activities,  organised 
to  accomplish  certain  goals.  There  exist  no  precise,  standard  techniques  for 
describing  the  C2  process,  much  less  for  analysing  or  designing  it.  Part  of 
the  difficulty  in  describing  this  process  is  bscause  it  is  a  dynamic  process, 
carried  out  by  a  team  of  people,  who  may  be  distributed  over  a  large  geo¬ 
graphic  region  and  who  are  forced  to  operate  under  conditions  of  both  infor¬ 
mation  and  outcome  uncertainty  In  achieving  their  individual  goals  and  those 
of  the  overall  C2  organisation. 


1.4  OUTLINE  OF  THE  REPORT 

Section  2  reviews  several  theories  of  human  respouse  and  introduces  the 
SHOR  paradigm.  Section  3  describes  a  mathematical  model  of  the  decision- 
maker's  hypothesis  evaluation  procedure  cast  in  the  normative  framework.  A 
discussion  of  the  effort  to  date  and  recommendations  for  next  year's  research 
comprise  Section  4. 
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SECTION  2 

HUMAN  RESPONSE  MODELING 

The  major  task  for  this  project  is  to  model  human  behavior  in  epecific 
altuations  and,  in  particular,  to  model  high-level  decisionmaking  for  anti¬ 
submarine  warfare  commanders  (ASWCs).  It  is  generally  agreed  that  a  model  con¬ 
sists  of  a  set  of  assumptions,  an  organisational  framework,  and  a  set  of  rules 
for  manipulating  the  details  of  the  model.  Models  of  human  behavior  are  usu¬ 
ally  validated  using  human  performance  data  obtained  from  laboratory  simula¬ 
tions  and/or  field  experiments  [7;8;9]. 

Several  approaches  can  be  employed  for  modeling  human  behavior  as  de¬ 
picted  in  Fig.  2-1*  These  approaches  can  range  from  simple  descriptive  models 
to  models  depicting  optimal  human  behavior.  Most  of  these  models  can  be  cate¬ 
gorized  into  three  classes  as  discussed  below. 

2.1  DESCRIPTIVE  MODELS 

The  descriptive  models  of  human  response  attempt  to  accurately  depict 
observed  human  behavior.  As  such,  these  models  require  an  oftentimes  large 
data  base  in  order  to  explore  relationships  and  deduce  treids.  By  construct, 
descriptive  models  in  the  engineering  domain  are  a  posteriori  in  nature,  and 
often  with  little  or  no  underlying  theoretical  foundation.  The  model  results 
are  generally  task  specific,  since  they  focus  only  on  the  data  associated 
within  a  specific  context.  The  net  result  is  a  model  with  extremely  limited 
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Figure  2-1.  Models  of  Human  Behavior 

predictive  capability  in  describing  human  response  or  performance  in  a  dif¬ 
ferent  environment.  Human  response  models  that  are  rooted  in  psychology, 
biology,  and  ergonomics  are  often  descriptive. 

An  example  of  a  descriptive  model  is  the  error  rate  of  a  human  in  a  tar¬ 
get  identification  and  classification  task  (e.g.,  attack  or  reconnaisance  air¬ 
craft,  friendly  or  enemy).  The  error  rate,  e.g.,  2  e^rors/1000  targets,  as 
measured  in  the  performance  of  the  classification  task,  is  not  linked  to  any 
underlying  theoretical  reasoning.  Also,  it  is  doubtful  whether  this  number 
has  any  utility  if  one  wishes  to  know  the  error  rate  in  a  different  task 
environment,  or  when  the  operator  is  provided  with  better  information. 

Most  descriptive  models  are  regressive.  In  this  framework,  a  human's 
control  or  decision  (or  dependent)  variable,  d^,  is  written  as  a  linear 
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combination  of  the  pertinent  system  variables  or  attributes  (i.e.,  the  inde¬ 
pendent  variables),  x j , 


di  -  I  cijxj 


The  coefficients  c* j ,  which  are  the  slopes  of  the  regression  lines,  are  de¬ 
rived  by  regression  analysis  using  data  for  the  xj  and  .  This  equation 
forms  the  basis  for  the  early  models  of  manual  control  and  for  many  other  de¬ 
cision  models.  However,  a  drawback  of  these  models  is  that  the  resulting  c^j 
have  no  intrinsic  meaning;  if  the  task  is  changed,  a  new  set  of  data  must  be 
collected  and  a  new  set  of  cij's  computed.  Clearly,  such  a  model  is  not 
predictive. 

2.2  NORMATIVE  MODELS 

This  class  of  models  is  predicated  on  the  assumption  that  human  behavior 
is  optimal  in  some  well-defined  manner.  For  example,  in  a  decision  context 
one  can  assume  that  the  human  will  compete  against  nature  (or  an  adversary)  to 
maximize  his  expected  gain,  or  utility,  over  a  given  time  horizon.  In  another 
view,  one  can  assume  that  the  human's  response  is  specified  by  a  regressive 
equation  similar  in  form  to  that  presented  above  but  then  the  human  tries  to 
maximize  reward  -  or  any  rational  criterion  -  by  optimizing  the  selection  of 
the  coefficients  c± j .  Decisionmaking  models  developed  through  the  more  mathe¬ 
matically  oriented  disciplines,  such  as  the  control,  stochastic  estimation, 
information,  probability,  and  decision  theories  are  typically  normative. 

The  key  ingredient  for  developing  a  normative  model  is  the  specification 
of  an  objective  function  or  goal  that  is  assumed  to  be  extremized  by  the 
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human.  Once  specified,  tools  of  optimization  theory*  can  be  applied  to  solve 
for  ar.  optimal  policy  or  decision  rule.  Thus,  the  approach  is  capable  of  gen¬ 
erating  piedictions  of  optimal  human  response  without  the  need  for  _a  priori 
data.  Furthermore,  the  optimization  approach  is  not  limited  to  any  type  of 
task  so  long  as  a  task  objective  can  be  specified. 

This  class  of  models  prescribes  what  a  human  should  do.  However,  experi¬ 
ence  with  such  models  has  shown  that  the  model  results  tend  to  be  overly  opti¬ 
mistic,  i.e.,  model  performance  exceeds  human  performance;  human  performance 
is  nonoptimal.  This  is  exemplified  by  the  findings  of  Tversky  and  Kahneman 
[10],  Lopes  [11],  and  Einhorn  and  Hogarth  [12],  all  of  which  Indicate  that 
people  do  not  adjust  their  probability  estimates  in  strict  accordance  with 
Bayes  theorem.  Attempts  to  bring  model  results  into  agreement  with  data  usu¬ 
ally  focus  on  generating  a  nonoptimal  decision  rule  for  the  human,  or  on  modi¬ 
fying  his  objective  function.  Thus,  concepts  such  as  discounting  future  re¬ 
wards,  optimization  over  a  limited  future  horizon,  and  substitution  of  util¬ 
ities  for  task  values  have  been  Introduced  as  modifications  to  otherwise  purely 
normative  models. 

2.3  NORMATIVE-DESCRIPTIVE  MODELS 

This  class  of  models  is  normative  in  construct,  but  with  the  assumption 
that  the  nonoptimality  of  the  decisionmaker  arises  from  his  own  inherent  limi¬ 
tations;  for  example,  delays  in  identifying  and  classifying  targets,  aggre¬ 
gating  and  processing  information,  randomness,  limited  processing  “bandwidth,” 
short-term  memory  (STM)  limitations,  and  limited  combinatorial  capability. 

*For  example,  dynamic  programming,  maximum  principle,  calculus  of  variations, 
least  squares,  etc. 
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Thus,  che  normative -descriptive  model*  ere  couched  on  the  hypothesis  that  the 
human  tries  to  respond  optimally ,  subject  to  these  limitations.  This  norma¬ 
tive  construct  requires  the  specification  of  an  objective  function  or  goal, 
as  in  the  normative  case,  but  optimisation  is  now  constrained. 

The  descriptive  features  of  the  models  are  those  associated  with  the  hu¬ 
man's  limitations.  Thus,  the  model  does  not  attempt  to  explain  why  or  how 
certain  limitations  arise,  but  rather  includes  their  effects  as  constraints. 
For  example,  numerous  experiments  in  the  psychological  literature  Indicate  a 
maximum  storage  capacity  for  STM  of  seven  (plus  or  minus  two)  items  [13]. 

Isolating  and  mathematically  representing  the  important  human  limitations 
is  the  essence  of  the  descriptive  portion  of  the  normative-descriptive  class 
of  models.  Clearly,  human  response  data  are  necessary  to  accomplish  this 
task.  In  addition,  we  must  ensure  that  the  limitations  are  not  task  depen¬ 
dent,  but  are  indigenous  to  the  human  among  tasks,  e.g. ,  time-delay  and 
randomness.*  Fortunately,  with  the  aid  of  human  response  data  from  the  ex¬ 
perimental  psychology  literature,  it  has  been  possible  to  isolate  and  quantify 
many  of  the  principal  limitations.  Thus,  the  normative-descriptive  models  are 
truly  interdisciplinary  in  nature.  They  are  also  capable  of  representing  in¬ 
dividual  differences. 

The  normative-descriptive  models  have  the  ability  to  generate  predictions 
of  human  response  and  performance  once  the  objective  function  and  limitations 
are  specified.  The  fact  that  this  class  of  models  lies  between  the  purely 
normative  ones  and  the  descriptive  ones  implies  that  this  approach  attempts 


♦Thus,  data  from  simple,  independent  experiments  that  focus  on  identifying  the 
limitations  can  be  used  as  a  descriptive  constraint  in  more  complex 
scenarios. 
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to  equate  vhat  a  human  does  with  what  he  should  do.  Employing  this  principle 
of  bounded  rationality,  the  normative-descriptive  models  have  generally  met 
with  excellent  success  in  application.  In  manual  control  situations,  the 
normative-descriptive  approach  led  to  the  development  of  the  optimal  control 
model  (OCM)  of  human  response  [7 ; 8 ] •  In  complex  decisionmaking  contexts  such 
as  C*  systems,  however,  where  the  cognitive  skills  of  the  operator  predominate 
over  the  motor  skills,  there  are  virtually  no  normative-descriptive  models. 
Indeed,  there  is  not  even  a  consensus  on  modeling,  and  only  a  few  descriptive 
studies  exist  in  process  control  situations  [14].  One  beacon,  however,  is 
the  application  of  a  normative-descriptive  construct  to  multitask  selection  or 
sequencing  where  a  variety  of  tasks  compete  for  the  decisionmaker's  attention. 
The  dynamic  decision  model  (DDM),  developed  for  this  situation,  captures  the 
interplay  among  human  estimates  of  time  required,  time  available,  and  expected 
reward,  while  including  submodels  for  various  human  limitations  [9].  There 
has,  however,  been  a  paucity  of  research  aimed  at  extending  the  normative- 
descriptive  modeling  approach  to  more  complex  decisionmaking  tasks  such  as 
those  of  C2.  An  example  does  exist  within  the  electrical  power  domain  [15], 
in  which  the  decisionmaking  behavior  of  power  grid  dispatchers  in  emergency 
situations  has  been  successfully  modeled  in  line  with  normative-descriptive 
constructs. 

2.4  MODES  OF  HUMAN  BEHAVIOR 

Another  issue  that  must  be  addressed  when  modeling  human  decisionmaking 


is  the  classification  and  representation  of  the  different  modes  of  behavior. 
Rasmussen  [16]  has  suggested  a  classification  that  delineates  three  types  of 
behavior:  skill  based,  rule  based,  and  knowledge  based. 
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Skill-based  behavior  refers  to  actions  with  a  strong  habitual*  inveterate 
flavor*  such  as  manual  control  or  simple  Information  processing.  Not  much 
conscious  attention  need  be  directed  toward  such  behaviors.  Behavior  that  is 
governed  by  procedures  or  doctrine  is  termed  rule  based.  Knowledge -based  be¬ 
havior  requires  individuals  to  extract  the  appropriate  information  from  their 
knowledge  base  and  construct  or  deduce  the  appropriate  rules  or  skills  to 
employ.  It  is  assumed  that  decisionmaking,  hypothesis  generation  and  hypoth¬ 
esis  testing  involve  knowledge-based  behavior. 

The  importance  of  appropriately  identifying  what  class  or  classes  of  be¬ 
havior  are  involved  bears  directly  on  how  that  behavior  is  to  be  modeled. 
Skill-based  behavior  might  call  for  neurophysiological  equations,  while  look¬ 
up  tables  or  production  systems  can  be  used  to  represent  rule-based  behavior. 
Knowledge-based  behavior  requires  a  different  and  more  abstract  tack*  such  as 
knowledge  of  objective  functions,  cost  functions*  or  goals*  so  that  such  be¬ 
havior  can  be  encoded. 


2.5  THE  SHOR  PARADIGM 

The  SHOR  paradigm  [1]  was  developed  to  provide  a  framework  for  decision 
task  description  in  C2.  A  task  will  often  have  certain  well-defined  proper¬ 
ties  or  structures  and  it  is  the  purpose  of  SHOR  to  provide  a  useful  mechanism 
to  describe  these  salient  task  features. 

In  essence*  the  SHOR  paradigm  is  derived  from  the  stimulus-response  (S-R) 
principle  [5]  of  classic  behavioral  psychology.  The  basic  elements  of  the 
SHOR  paradigm  are  shown  in  Table  2-1.  As  depicted  in  the  table*  raw  data  are 
sensed  and  processed  by  the  perception  processor,  l.e.*  in  the  S  component 
of  SHOR.  Processed  data  are  then  operated  on  by  the  H  component  of  the  SHOR 
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paredlgm.  This  operation  addresses  the  question:  What  is  the  situation  or 
state  of  the  system?  Hypotheses  are  generated  and  evaluated  to  formulate  or 
to  describe  the  state  of  the  system.  Once  hypotheses  are  formulated ,  the  0 
or  option  generation  and  evaluation  operation  addresses  the  question:  What 
if  this  or  that  is  done?  Options  are  considered  and  evaluated  in  the  light 
of  the  current  hypotheses  about  the  situation  and  the  desired  mission  objec¬ 
tives.  Lastly,  an  action  or  response,  R,  is  organised  and  executed  in  line 
with  the  option  selected,  and  in  turn  creates  an  observable  effect  on  the 
states  of  nature. 

TABLE  2-1.  SHOR  PARADIGM  IN  TERMS  OF  TASK  ELEMENTS 


STIMULUS 


HYPOTHESIS 


OPTIONS 


RESPONSE 


TASK 

PROCESS 

DATA 

MAP  DATA  INTO 
INFORMATION 

EVALUATE 

ADMISSIBLE 

ACTIONS 

EXECUTE 

ACTIONS 

INPUT 

ENVIRONMENTAL 

DATA 

SENSORY 

DATA 

HYPOTHESES 
ABOUT  STATE 

OF  NATURE 

DECISIONS  THAT 
AFFECT  STATES 

OUTFUT 

SENSORY 

DATA 

HYPOTHESES 
ABOUT  STATE 

OF  NATURE 

i 

DECISIONS  THAT 
AFFECT  STATES 

RESPONSES 
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2.6  ELABORATION  OF  THE  SHOR  PARADIGM 

It  Is  assumed  thr t  the  decisionmaker  Is  continually  processing  and  ana¬ 
lysing  Information  and,  when  necessary,  executing  responses  that  have  some 
specific  Impact  on  the  real  world.  Thus,  to  observe  a  decisionmaker  is  to 
observe  an  ongoing  process,  and  when  using  SHOR  to  describe  this  process  it 
must  be  viewed  as  dynamic. 

It  is  assumed  that  the  decisionmaker's  actions  or  responses  affect  the 
real  world  through  a  set  of  controlled  variables.  The  effect,  of  these  re¬ 
sponses,  as  well  as  those  of  other  uncontrolled  variables  (e.g.,  enemy  action 
and  weather),  are  detectable  by  surveillance  and  intelligence  sensors,  and 
can  become  input  data  or  stimuli  for  the  perception  processor.  The  percep¬ 
tion  processor  utilizes  data-driven  and/or  concept-driven  processes  to  search 
the  Incoming  data  for  patterns  to  recognise  and  classify. 

The  hypothesis  or  set  of  hypotheses  under  consideration  is  the  result  of 
Interaction  in  the  perception  processor  between  the  incoming  data  and  the  hu¬ 
man's  internal  representation  or  mental  model  of  the  total  system  with  which 
he  is  dealing.  The  more  expert  the  individual,  the  sharper  and  richer  the 
mental  model.  In  any  case,  the  resulting  hypothesis  provides  the  basis  for 
comparison  of  the  incoming  data  with  predictions  derived  from  the  hypothesis. 
Given  a  set  of  alternative  hypotheses,  Incoming  data  may  serve  to  increase 
the  decisionmaker's  subjective  confidence  in  one  hypothesis  over  the  others. 
Alternatively,  the  data  may  not  support  any  of  the  hypotheses.  Note  that  it 
is  this  condition  where  no  hypotheses  are  supported  by  available  data  that 
leads  to  an  alteration  of  one's  mental  model.  Likewise  a  single  hypothesis 
may  or  may  not  receive  support.  If  no  hypothesis  is  supported  by  the  data, 
one  must  then  reconsider  the  validity  of  both  data  and  hypothesis  and  perhaps 
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modify  the  hypothesis  accordingly.  Tha  hypothaaia  with  tha  graataat  subjec- 
tiva  confidence  or  parcalvad  llkalihood  of  baing  corract  will  ba  used  to  halp 
ganarata  raaponae  options  and,  ultiaataly  to  halp  aalact  a  rasponaa. 

2.6.1  Functions  and  Charactarlatica  of  tha  Parcaptlon  Processor 

At  the  stimulus  or  sensory  and  of  tha  parcaptlon  processor  we  are  dealing 
more  with  data  processing  than  information  processing,  although  the  two  pro¬ 
cesses  can  never  be  completely  dissociated.  If  we  consider  the  outside  world 
in  purely  physical  terms,  it  can  be  described  as  a  flux  of  energy  that  exists 
in  different  forms  and  at  different  levels  [17].  Here,  the  problem  is  one  of 
detection.  Human  sense  organs  are  responsive  to  only  a  tiny  portion  of  the 
electromagnetic,  mechanical,  and  chemical  flux.  Early  psychophysical  concepts 
of  fixed  sensory  thresholds  have  given  way  to  modern  signal  detection  theory, 
which  describes  variations  in  detection  probability  in  terms  of  a  receiver 
operating  characteristic  (ROC)  curve.  The  ROC  curve  depicts  the  likelihood  of 
a  subject's  guessing  that  there  is  a  signal  present  when  in  fact  there  is  one, 
and  the  likelihood  of  his  guessing  that  a  signal  is  present  when  in  fact  there 
is  none.  Signal  strength  relative  to  noise  bac*.^round  certainly  has  an  impor¬ 
tant  impact  on  the  ROC  curve  as  a  whole,  but  variables  such  as  cost,  utility, 
expectancy,  attitude,  and  the  like  are  equally  Important  in  that  they  serve  to 
bias  the  operating  point  or  the  ROC  curve.  In  fact,  it  has  been  argued  that 
in  most  real  situations  detection  results  are  determined  more  as  a  function  of 
subjective  variables  (e.g.,  perceived  costs  and  attitudes)  than  by  sensory 
acuity.  This  also  implies  that  appropriate  training,  specific  monitoring  pro¬ 
cedures,  and  well-designed  displays  can  mitigate  the  negative  effect  that  cer¬ 
tain  psychological  variables  can  have  on  detection. 
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DATA-DRIVEN  VERSUS  CONCEPT-DRIVEN  PROCESSING 

Operations  that  ara  tat  In  motion  by  arriving  data  ara  referred  to  as 
data  driven.  Lindsay  and  Norman  [18]  describe  the  data-driven  process  as 
follows:  the  onset  of  processing  is  Initiated  by  Incoming  data;  each  of  sev¬ 
eral.  stages  of  analysis  performs  its  operation  of  receiving  input  (data)  and 
doing  something  with  it;  and  the  outputs  of  each  stage  are  the  Inputs  that 
drive  the  next  stage.  This  process  proceeds  in  a  smooth,  logical  progression 
culminating  in  the  recognition  of  the  item.  Nothing  happens  within  a  data- 
driven  system  until  data  are  input  at  one  end.  This  is  contrasted  with  a 
concept-driven  process,  which  begins  with  a  conceptualisation  of  what  might  be 
present  (l.e.,  a  hypothesis)  and  then  lcvka  for  confirming  evidence,  influ¬ 
encing  the  processing  mechanism  to  search  for  the  expected  results  [18].  A 
perceptual  process  is  concept-driven  whenever  knowledge  of  the  possible  inter¬ 
pretation  or  conceptualisation  of  something  helps  in  perceiving  that  thing. 
Finally,  it  must  be  emphasised  that  neither  process  alone  is  sufficient  to 
explain  or  carry  out  the  perceptual  processing  of  data.  Therefore,  in  this 
study  both  are  assumed  t>  be  occurring  simultaneously. 

CLASSIFICATION  AND  RECOGNITION 

Initial  perceptual  processing  of  the  century  data  involves  both  attention 
allocation  and  pattern  recognition.  First,  it  ia  necessary  to  aort  out  rele¬ 
vant  data  from  the  myriad  of  aansory  inputs.  Than  the  problem  becomes  one  of 
pattern  recognition.  Immediately  we  are  faced  with  an  apparent  paradox:  it 
appears  that  we  must  understand  the  meaning  of  data  before  we  can  analyse  its 
content  properly;  but  how  can  we  understand  the  meaning  of  data  before  the 
analysis  of  its  content  has  occurred  [18]?  If  we  assume  that  the  human  brain 
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Is  capable  of  simultaneous  analysis  at  savaral  levels*,  a  resolution  of  the 
paradox  la  possible.  In  particular,  we  assume  that  perception  is  both  concept- 
driven  and  data-driven,  that  these  two  forms  of  processing  interact  with  each 
other,  and  that  their  combined  power  is  capable  of  analysing  data  that  neither 
process  can  deal  with  alone. 

One  of  the  simplest  schemes  for  classifying  and  recognising  patterns, 
and  a  prime  example  of  a  data-driven  process,  is  template  matching.  For  each 
pattern  to  be  recognised  there  must  be  some  preexisting  template  (representa¬ 
tion).  To  accomplish  recognition,  the  incoming  data  pattern  is  matched  against 
the  preexisting  template.  Template  matching  is  quite  straightforward;  since 
incoming  data  patterns  are  assumed  to  be  matched  against  all  of  the  possible 
templates  simultaneously,  the  cumbersome  procedure  of  trying  out  a  succession 
of  templates  one  at  a  time  to  find  the  best  fit  is  eliminated.  Unfortunately, 
simple  template  matching  lacks  the  flexibility  to  account  for  human  pattern 
recognition,  alnce  if  the  incoming  data  varies  even  slightly  (e.g.,  in  slse  or 
orientation )  from  the  template,  the  procedure  will  fall.  The  introduction  of 
fussy  templates  or  of  preprocessing  of  the  data  before  a  match  is  attempted 
can  of tan  improve  matching. 

An  alternate  view  is  that  specific  templates  are  not  employed.  Rather, 
specific  feature  detectors  are  used,  and  there  is  good  evidence  that  such  de¬ 
tectors  not  only  exist  but  map  directly  onto  neurological  structures  and  or¬ 
ganisations  within  the  brain.  According  to  this  theory,  a  succession  of  fea¬ 
ture  processors  work  on  the  incoming  data,  with  each  processor  performing  a 

*The  brain's  ability  to  simultaneously  process  information  at  different  levels 
is  supported  by  the  work  of  Karl  Pribram,  who  argues  that  the  brain  is  holo¬ 
graphic  in  nature  when  considering  storage  and  processing  [19]. 
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different  function.  The  outcoae  is  a  decision  on  what  the  most  likely  pattern 
le  that  conferee  to  the  data.  If  conceptual  processing  (i.e.,  some  knowledge 
or  expectation  of  what  the  data  must  be  beyond  what  is  actually  present  In  the 
data)  Is  added  to  such  feature  processing,  the  likelihood  of  successful  inter- 
p rotation  la  further  Increased.  This  added  information  eight  com  froa  the 
context  of  the  aensory  data,  where  the  overall  tnvironMnt  in  which  experiences 
are  eabedded  represents  what  in  Mant  by  context.  As  Lindsay  and  Norman  [18] 
have  pointed  out,  the  ability  to  use  context  makes  the  human  perceptual  syotea 
far  superior  ?nd  aore  flexible  than  either  feature  detection  or  .emplate  match¬ 
ing  alone.  The  combined  effects  of  data-driven  and  concept-driven  processes 
thus  provide  a  basis  upon  which  higher  cognitive  processes  can  act. 

Note  that  while  descriptive  paradigms  such  as  those  Motioned  above  exist, 
there  are  at  present  no  MtheMtlcal  models  of  these  processes  and  few  good 
theories  on  which  to  base  such  models. 

2.6.2  The  Human  Internal  Model 

As  a  human  becomes  well-trained  in  a  specific  Mn-machine  system  task  and 
context,  he  develops  an  internal  characterisation  of  the  dynamical  response 
and  behavior  of  the  system  with  which  he  Interacts  [ 14 ) •  This  Mntal  model, 
which  la  refined  through  the  processes  of  learning  and  experience,  is  one  of 
the  key  discriminators  between  rule-based  human  response  and  knowledge-based 
response  [16].  As  auch,  inferring  the  huatn's  internal  model  is  a  necessary 
precursor  to  the  developMnt  of  norMtive  and  normative-descriptive  models. 

The  concept  of  a  mental  model  has  long  been  recognised  in  the  psychol¬ 
ogical  literature  (e.g..  To lean's  "cognitive  maps"  or  Levin's  "life-space") 

[ 20; 21],  but  only  of  late  has  the  concept  begun  to  evolve  into  a  mathematical 
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construct*. ,  sufficiently  wall  understood  for  inclusion  within  an  overall  huaan- 
systea  aodel  [9].  An  Internal  or  aental  aodel  aay  be  thought  to  consist  of 
three  basic  ingredients:  (1)  a  description  of  the  variables  (states)  of  Im¬ 
portance,  including  external  inputs  and  disturbances  (independent  variables) 
nd  outputs  (dependent  variables);  (2)  the  assuaed  causal  and/or  correlational 
relationships  that  racist  aaong  the  variables;  and  (3)  values  for  the  coeffi¬ 
cients  (relative  laportance  of  terns)  in  the  equations  tnat  define  the  rela¬ 
tionships.  In  any  given  context  the  process  of  eliciting  or  inferring  a  Hu¬ 
nan's  Internal  aodal  of  eystea  response  is  extreaely  difficult.  In  highly 
coaplex  decisionmaking  contexts,  the  nuaber  of  system  variables  becomes  too 
large,  ao  that  aggregation  or  chunking  within  the  Internal  nodal  is  likely. 

In  addition,  static  relationships  aaong  variables  are  likely  to  dominate  in 
the  Internal  aodel. 

An  Internal  aodel  serves  three  prlaary  functions  in  the  broader  human- 
systea  node ling  context:  hypothesis  generation,  data  interpolation,  and  out¬ 
come  extrapolation.  First,  the  relationships  aaong  variables  in  the  internal 
model  can  be  used  in  the  process  of  transforming  data  into  information  by  aeans 
of  filtering,  estimation,  correlation,  and  discarding  of  input  stimuli.  It  in¬ 
volves  data  validation,  which  in  turn  affects  Internal  aodel  validation.  The 
second  function  of  the  aental  aodel  involves  its  use  for  prediction  or  extrap¬ 
olation,  l.e.,  in  directing  the  search  for  confirming  or  disconf irmlng  data. 
This  is  the  process  of  deteraining  what  additional  data  should  be  perceivable, 
given  that  the  hypothesis  based  on  the  mental  aodel  is  the  true  one.  This  re¬ 
quires  a  rich  and  robust  aental  aodel,  an  estimate  of  the  present  state,  and 
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an  estimate  ot  system  inputs/disturbances  cvar  a  predict ton  horizon.  Herein 
lies  one  of  the  two  main  eourcee  of  uncertainty  In  decisionmaking: 

•  Information  Input  uncertainty.  Brrore  in  eetinating  the 
preeent  etate  due  to  Imperfect  Internal  modeling  or  sen- 
eory  llmltatlone  in  perceiving  input  data  will  affect 
prediction,  interpolation,  and  evaluation  accuracy. 

Since  the  Internal  model  la  only  an  approximation  to  the  actual  situa¬ 
tion  or  system  dynamics,  the  effects  of  uncertainties  will  always  be  present. 
Indeed,  it  la  often  possible  for  an  Internal  model  to  be  misled,  thereby  exac¬ 
erbating  the  effects  of  any  uncertainties.  Finally,  the  third  function  of  the 
mental  model  involves  its  use  In  outcome  extrapolation  and  option  analysis. 

The  Internal  construct  that  a  Naval  warfare  commander  holds  of  the  process  of 
a  mission's  unfolding  not  only  serves  to  correlate  the  various  measurements 
he  obtains,  but  also  provides  him  with  a  means  to  assess  the  effects  of  an 
action.  Herein  lies  the  second  major  source  of  uncertainty  in  decisionmaking: 

•  Consequence-of-action  uncertainty.  Errors  in  the  internal 
model  relations,  combined  with  large  uncertainty  as  to  the 
decisions/actions  of  nature  or  an  adversary,  will  cause  the 
future  evolution  of  system  response  to  differ  from  that 
predicted  by  the  internal  model. 

Determination  of  a  suitable  mental  construct  and  representation  by  a  set 
of  verbal  rules  or  mathematical  equations  for  purposes  of  analysis  is  a  neces- 
aary,  albeit  difficult,  aspect  of  describing  an  individual's  cognitive  activi¬ 
ties  in  a  given  situation.  On  the  one  hand,  the  internal  model  must  capture 
the  fundamental  static  and  dynamic  relationships  inherent  in  the  military  sit¬ 
uation  or  engagement.  On  the  other  hand,  the  model  must  be  sufficiently  sim¬ 
plified  and  or  aggregated  so  as  to  be  compatible  with  human  cognitive  limita¬ 
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2.6.3  Hypotheses 

In  many  ways  the  concept  of  a  mental  model  Is  closely  allied  with  that 
of  a  hypothesis.  For  example,  ore  can  conceive  of  a  hypothesis  as  a  mental- 
model  aggregated  and  specified  for  a  particular  set  of  circumstances.  This 
conception  assumes  that  a  subset  of  the  variables  delineated  in  the  "general** 
or  “full**  mental  model  are  selected  for  the  specific  situation  at  hand,  to¬ 
gether  with  the  appropriate  functional  relationships  and  coefficients.  Each 
hypothesis  represents  a  specific  conceptualization  of  the  state  of  nature 
and  hence  a  model  of  the  particular  situation  -  it  is  the  human's  attempt  to 
assess  the  situation. 

It  is  assumed  that  an  individual  can  hold  more  than  one  hypothesis  at  a 
time,  which  Implies  different  alternative  specifics  of  the  situation.  An 
individual  in  such  a  situation  might  be  heard  saying:  if  the  situation  is  not 
"A"  (if  **A“  is  not  the  state  of  the  system),  then  it  might  be  **B*‘  (some  ether 
state  of  the  system).  Given  human  STM  limitations,  however,  it  is  unlikely 
that  an  individual  can  seriously  consider  more  than  two  or  three  hypotheses  at 
any  one  time. 

2.7  HYPOTHESIS  GENERATION,  MENTAL  MODELS,  AND  MEANING 

Hypothesis  generation  addresses  the  problems  of  how  people  generate  a 
reasonable  set  of  hypotheses  and  modif)  the  set  as  the  need  arises.  Hypoth¬ 
esis  generation,  including  what  is  commonly  referred  to  as  creative  thinking, 
Involves  searching  memory  for  relationships  that  seem  appropriate  to  the 
situation. *  Well-trained  individuals  by  definition  possess  a  rich  and 

*In  spite  of  its  importance,  until  quite  recently  very  little  attention  was 
devoted  to  the  issue  of  hypothesis  generation  (see  Bruner,  Goodnow,  and 
Austin  122]  or  Wason  [23]  for  some  laboratory  experiments  on  concept  at¬ 
tainment  and  “discover  the  rule"  type  tasks). 
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detailed  knowledge  base  and  nental  model  fror  which  to  infer  possible  situa¬ 
tions  causing  an  event*  But  what  exactly  is  it  that  these  experts  are  doing? 

Is  it  a  creative  activity  (a  mentalist  view),  or  are  they  simply  processing 
information  (a  reductionist  view)?  Neither  view  appears  tenable  since  the 
former  is  not  subject  to  experimental  verification  and  the  latter  does  not 
address  the  underlying  meaning  of  the  information  being  processed.  In  fact, 
whereas  information  theory  sidesteps  the  issue  of  meaning  and  deals  only  with 
symbol  transmission  rates  and  errors,  understanding  and  describing  the  human 
decisionmaking  process  requires  the  consideration  and  operational  definition 
of  meaning.  He  assert  that  the  fundamental  purpose  of  hypothesis  generation 
is  to  extract  meaning  from  data.  This  assertion  gives  rise  to  a  measure  of 
performance  for  the  hypothesis  generation  subtask.  Since  data  take  on  meaning 
in  the  form  of  hypotheses,  the  extraction  of  meaning  from  data  can  be  measured 
in  terms  of  hypothesis  uncertainty.  As  we  shall  see,  the  task  of  hypothesis 
generation  thus  is  really  a  task  of  meaning  extraction  and,  concomitantly, 
uncertainty  reduction. 

Uncertainty  in  physics  and  in  information  theory  is  a  well-defined  mathe¬ 
matical  concept,  one  directly  associated  with  the  variance  of  a  stochastic  pro¬ 
cess  auu  the  resultant  probability  of  occurrence  of  a  given  outcome  at  a  given 
time.  While  this  approach  is  satisfactory  from  a  mathematical  standpoint,  the 
term  itself  is  subject  to  confusion  and  argument  when  attempts  are  made  to 
extend  its  application  beyond  physical  systems.  Shannon,  for  example,  explic¬ 
itly  chose  to  eliminate  the  concept  of  meaning  from  his  work,  defining  infor¬ 
mation  as  negative  entropy  (or  certainty)  In  terms  of  discrete  symbols  and 
their  probabilities  of  occurrence,  or  In  terms  of  signal-to-noise  ratio  124], 
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This  limited  definition,  while  extremely  powerful  for  communications 
system  engineering  purposes,  is  of  little  use  in  designing  C3  systems.  A  C3 
system's  major  functions,  in  addition  to  the  obvious  ones  of  (1)  gathering 
and  disseminating  Information,  and  (2)  planning,  organizing,  and  executing 
responses;  Include  assisting  decisionmakers  in  extracting  meaning  and  in 
predicting  outcomes. 

•  Meaning  extraction.  An  issue  in  extracting  meaning  from 
input  information  appears  to  be  how  military  commanders 
deal  with  hypotheses.  Fcr  example,  having  no  hypothesis 
about  the  meaning  of  a  given  input  data  set  is  tantamount 
to  all  possible  hypotheses  being  equally  likely.  At  the 
other  extreme,  having  a  large  and  well-structured  set  of 
hypotheses  tends  to  overburden  one  in  the  opposite  direc¬ 
tion.  Neither  extreme  serves  to  focus  attention  upon 
what  new  Information  is  to  be  nought.  Given  a  plethora  of 
information  and  a  number  of  hypotheses,  the  philosophical 
operatlonalist's  view  must  be  held:  a  hypothesis  is  use¬ 
less  unless  its  predictions  can  be  tested.  This  rule  will 
serve  to  reduce  the  set  of  hypotheses  under  consideration 
to  a  subset  of  testable  ones.  The  next  step  is  to  test, 
and  that  requires  that  new  information  be  sought.  As  a 
case  in  point,  new  sensor  and  sensor  correlation  equip¬ 
ment  on  Aegis  ships  will  be  able  to  provide  simultaneous 
Information  on  hundreds  of  targets.  The  critical  needs 
will  be  those  of;  (1)  blocking  irrelevant  Information, 
and  (2)  cueing  of  selected  sensors  to  obtain  discriminant 
information  on  selected  targets  in  real  time.  But  neither 
can  occur  in  the  absence  of  hypotheses.  One,  or  at  most 
a  very  few,  carefully  constructed  hypotheses  will  serve: 

(1)  to  eliminate  from  wasteful  consideration  that  input 
information  that  is  not  relevant,  and  (2)  to  direct  atten- 
ion  to  requisite  new  discriminant  Information  to  further 
reduce  the  hypothesis  set.  We  assert  that  tacticians, 
strategists,  diagnosticians,  executives,  and  commanders 
are  expert  to  the  degree  that  they  possess  and  effectively 
exercise  this  ability  of  hypothesis  generation  and  testing. 

Wise's  [25]  concept  of  "emergent  decisionmaking"  implies  a 
process  of  hypothesis  creation,  development,  refinement, 
test,  rejection,  modification,  and  ultimate  acceptance  and 
action.  As  suggested  by  Wohl  [1],  the  convergence  of  this 
process  may  give  rise  to  the  perceived  "emergence”  of  a 
decision.  We  further  assert  that  the  rate  of  hypothesis 
convergence  is  an  important  contributor  to  the  rate  of 
reduction  of  subjective  uncertainty. 
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•  Outcome  prediction.  The  key  issue  in  predicting  military 
outcomes  seems  to  be  how  commanders  utilize  the  hypotheses 
they  construct.  As  noted  earlier,  his  mental  model  is 
really  a  commander's  aggregated  model  of  reality.  To  the 
extent  that  his  model  is  accurate  and  the  sources  of  vari¬ 
ance  (e.g.,  data  accuracy,  enemy  and  own  force  behavior, 
and  weather)  are  small,  he  can  formulate  hypotheses  and 
predict  outcomes  associated  with  various  action  alternatives. 

While  the  coimsander's  model  of  reality  is  certainly  not  a 
mathematical  one,  he  nonetheless  uses  it  in  just  the  same 
way  as  a  scientist  does.  Based  on  data,  he  constructs  a 
hypothesis  involving  events,  relationships,  and  causality. 

He  then  tests  his  hypothesis  by  using  it  to  predict  the 
course  of  events  given  a  new  set  of  conditions,  later 
observing  the  degree  of  concordance  of  the  actual  versus 
predicted  course  and  modifying  his  hypothesis  accordingly. 

Thus  we  see  that  the  hypothesis,  as  well  as  being  a  model 
of  reality,  can  also  act  in  a  very  real  way  as  a  gen¬ 
erating  function  for  future  scenarios. 

It  is  important  to  note  that  the  number  of  hypotheses  generated  with  re¬ 
spect  to  a  given  data  set  is  not  a  useful  measure  in  this  context,  contrary  to 
Gettys  et  el.  [26] ,  As  noted  above,  too  many  hypotheses  are  as  detrimental  as 
none  at  all. 

Thus,  how  human  decisionmakers  accomplish  hypothesis  generation  is  a 
critical  issue.  Recent  work  on  analogical  reasoning  and  mental  models  has 
shed  some  light  on  the  process  of  human  hypothesis  generation.  The  analogical 
reasoning  view  of  Klein  [27]  asserts  that  when  faced  with  a  problem  or  a  de¬ 
cision  situation  we  search  memory  for  similar  or  analog  situations;  the  solu¬ 
tions  to  past  problems  (or  minor  variations  of  them)  become  the  current  hy¬ 
pothesis  set  to  be  tested.  A  process  similar  to  the  analog  process  is  to  scan 
memory  for  a  parallel  situation  and  then  to  manipulate  the  variables  that  seem 
to  have  led  to  solutions  in  the  past  for  possible  applications  to  the  present 
problem. 
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The  mental  model  position  [28;29]  contends  that  the  hypothesis  set  de¬ 
rives  directly  from  the  Interaction  of  input  Information  with  an  expert  deci¬ 
sionmaker's  mental  model  or  internal  representation  of  a  problem  situation. 

If  a  itointal  odel  can  serve  as  a  theory  does  In  science,  then  hypotheses  can 
be  derived  from  them  In  a  similar  manner;  namely  from  the  set  of  elements  or 
variables  comprising  the  theory,  the  functional  relationships  among  the  ele¬ 
ments  or  variables,  and  the  constraints  on  the  functional  relationships.  By 
extension,  the  same  should  hold  for  expert  knowledge  domains. 

For  highly  trained  expert  decisionmakers  (commanders),  the  analogical 
view  of  hypothesis  generation  seems  an  appropriate  position.  For  example,  we 
assume  that  ASWCs  will  be  searching  their  knowledge  base  for  similar  or  anal¬ 
ogous  situations  as  a  basis  from  which  to  generate  plausible  hypotheses  about 
the  current  state  of  nature. 
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SECTION  3 

MATHEMATICAL  REPRESENTATION  OF  SHOR:  CONCEPTS  AND  PROCESSES 

This  section  describes  the  mathematical  details  of  the  normative  model 
of  the  human  decisionmaking  process  as  developed  to  date.  The  model  is  com¬ 
posed  of  well-known  types  of  simple  components,  chosen  for  their  tractabillty 
and  familiarity,  which,  when  combined,  behave  like  a  human  decisionmaker. 

The  model  components  were  selected  for  their  input-output  behavior,  and  not 
because  their  Internal  workings  resemble  those  of  the  human  mind.  Similarly, 
the  model  details  might,  at  times,  seem  more  complex  or  redundant  than  the 
human  internal  processes  we  associate  with  them.  For  example,  we  need  rela¬ 
tively  sophisticated  mathematics  to  capture  the  idea  of  a  human  choosing  the 
"best"  hypothesis,  or  reevaluating  the  data  in  the  light  of  a  new  hypothesis  - 
actions  that  seem  simple  and  natural.  The  complex  mathematics,  however,  have 
simple  parameters  that  we  can  associate  with  mental  views  of  the  world  and 
human  limitations. 

The  section  is  organized  as  follows:  subsection  3.1  presents  an  over¬ 
view  of  the  SHOR  model  as  developed  to  date.  Subsection  3.2  then  presents  an 
overview  of  the  first  half  of  the  model  (dealing  with  hypothesis  evaluation) 
in  more  detail,  and  subsection  3.3  describes  the  Individual  elements  used  for 
this  half.  Subsection  3.4  presents  an  example  of  what  the  model  variables 
would  be  in  a  hypothetical  ASM  application,  and  subsection  3.5  discusses  how 
model  behavior  relates  to  parameter  selection  (in  particular,  how  errors 
behave  with  time). 
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3.1  SHOR  OVERVIEW 

The  SHOR  paradigm  represents  a  sequential  breakdown  of  human  informa¬ 
tion  processing.  New  information  (stimuli)  are  processed  and  given  meaning  - 
causing  one  or  more  hypotheses  to  be  generated  and  considered.  These  hypoth¬ 
eses,  and  the  decisionmaker's  estimates  of  their  relative  probabilities  of 
being  true,  are  used  to  evaluate  possible  actions  (options)  before  a  response 
is  chosen.  The  process  is  shown  schematically  in  Fig.  3-1,  where  the  stimulus 
(S),  hypotheses  (H*),  and  response  (R)  are  process  variables  (functions  of 
time)  and  the  hypothesis  and  option  evaluators  (H,0)  represent  operations  on 
these  variables.  The  generation  of  hypotheses  and  options  requires  a  higher 
level  of  creativity,  and  modeling,  than  their  processing  and  evaluation,  and 
will  be  treated  separately  in  a  subsequent  phase  of  this  research  examining 
mental  models  as  generating  functions. 

The  overall  Intent  of  this  model  is  to  represent  the  human  decisionmaker 

as  a  controller  working  in  an  uncertain  environment  with  multiple  hypotheses 

about  what  is  going  on  in  the  battle.  This  process  can  be  represented  as  in 

Fig.  3-2,  where  the  stimuli  are  measurements  (z)  made  of  the  real  world;  state 
* 

estimates  (x)  and  subjective  probabilities  are  formulated  about  the  real  world 
and  control  actions  (u)  are  selected  to  affect  the  real  world. 

The  state  of  the  system  refers  to  the  total  collection  of  underlying 
variables  that  change  with  time  and  that  are  sufficient  to  capture  the  status 
of  a  system.  The  data  refer  to  the  much  smaller  collection  of  measurements  - 
noisy  samples  of  some  of  the  state  variables  -  that  are  available  to  the  deci- 

A 

sionmaker.  The  Btate  estimates  (x)  are  his  internal  estimates  of  the  true 
state,  based  on  all  of  the  data  available.  There  is  a  separate  state  estimate 
for  each  hypothesis,  since  each  corresponds  to  a  different  view  of  what  is 
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Figure  3-1.  SHOR  Model 
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Figure  3-2.  SHOR  Mathematical  Representation 
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going  on  (l.e.,  a  different  mental  model).  The  probability  p(Hi|z)  is  the  con¬ 
fidence  placed  on  each  hypothesis  (Hj_)  after  the  data  have  been  received  and 
considered.  All  of  the  variables  x,  s,  and  u  are  vectors  (i.e.,  they  can  have 
■ore  than,  one  element ,  such  as  positions ,  velocities,  or  orientations)  and  are 
functions  of  time  (either  continuous  or  discrete),  and  ve  wish  to  model  how 
they  evolve  and  change  as  new  information  arrives  and  time  passes. 

A  hierarchical  breakdown  of  a  SHOR  model  is  described,  specif lying  at  each 
stage  the  important  processes  and  variables  that  represent  each  component.  The 
highest-level  breakdown  was  into  SHOR  itself.  Certain  assumptions  are  implicit 
in  Fig.  3-2,  but  the  main  restriction  it  places  on  our  modol  is  the  passing  of 
only  state  estimates  and  probabilities  (for  each  hypothesis)  between  the  H  and 
0  blocks.  These  variables  were  chosen  as  both  sufficient  variables  for  option 
evaluation  and  significant  results  of  hypothesis  evaluation.  They  are  the  pri¬ 
mary  processes  that  capture  the  notion  of  attaching  meaning  to  the  data  from 
the  real  world,  and  they  answer  two  essential  questions:  (1)  given  a  set  of 
possible  hypotheses  how  does  the  data  support  or  refute  each  hypothesis?  and 
(2)  what  does  the  data  imply  about  the  state  of  the  battle  assuming  each  hy¬ 
pothesis  is  true?  The  answers  to  these  questions  are  represented  mathematl- 

A 

cally  by  the  conditional  probabilities  p(HjJz)  and  state  estimates  x*. 

Although  the  primary  emphasis  of  this  year's  effort  is  the  description  of 
the  hypothesis  processing,  it  is  important  to  make  certain  assumptions  about 
the  option  evaluation  component  in  order  tc  guarantee  the  sufficiency  of  the 
H  component  outputs,  l.e.,  only  the  posterior  probabilities,  p(Hi|z),  and  state 

A 

estimates,  x^,  are  necessary  to  discriminate  between  alternative  actions. 
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The  "best"  action  it  determined  by  the  "minimisation"  of  the  risk  of  los¬ 
ing  own-force  assets  (e.g.,  the  carrier  in  a  battle  group).  Explicit  trade¬ 
offs  aust  be  made  between  deploying  a  platform  to  proaecute  a  known  threat 
and  creating  "holes"  in  the  defense  (e.g. ,  increasing  vulnerability  to  the 
next*  as  of  yet  undetected,  threat).  Aa  a  consequence,  it  la  expected  that 
most  options  will  Involve  the  commitment  of  resources  to  better  determine  the 
situation,  l.e.,  to  enable  him  to  discriminate  between  hypotheses  by  taking 
more  measurements. 

3.2  HTFOTHESIS  EVALUATION 

Th*.  hypothesis  evaluation  component  receives  data  and  hypotheses  about 
the  real  world  and  determines  whether  the  data  support  each  hypothesis  and 
what  the  data  imply  about  the  state  of  the  world  if  each  hypothesis  were  true. 
For  our  purposes,  a  hypothesis  is  a  conjecture  about  what  is  going  on  -  it  is 
a  model  of  how  the  world  (or  local  battlefield  part  of  the  world)  works  and 
what  an  enemy  Intends.  It  must  describe  both  what  is  happening  end  what  is 
about  to  happen.  This,  in  fact,  is  similar  to  the  mathematical  notion  of 
state,  and  we  define  a  hypothesis  as  a  mental  model  of  the  world  in  which  the 
model  states  capture  the  current  information  about  the  world.  This  model  is 
much  smaller  than  a  human's  total  mental  model  of  the  battlefield.  The  hy¬ 
pothesis  may  be  thought  of  as  a  subset  of  the  total  model  with  specific  param¬ 
eters  or  Nuberodels  replacing  uncertain  components  in  the  larger  model. 

For  example,  an  expert  commander  knows  how  vehicles  behave,  weapons  work, 
and  battles  evolve,  but  he  may  be  uncertain  about  what  an  enemy  is  doing.  His 
hypotheses  may  be  several  alternate  models  of  what  the  enemy  is  doing,  based 
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on  components  chosen  froa  his  experience  end  hit,  whole  aodel.  The  hypotheses 
thus  fit  within  the  larger  aodel  and  yet  are  mote  specific*  or  less  uncertain* 
than  the  larger  aodel. 

The  first  requireaent  for  the  hypotheses  is  that  they  be  different  enough 
to  laply  different  states  that  can  be  observed  froa  the  data*  l.e.*  the  dif¬ 
ference  between  hypotheses  must  be  both  discernible  and  observable.  Two  hy¬ 
potheses  that  differ  only  in  an  insignificant  or  unobservable  detail  are  not 
considered.  Of  course,  hypotheses  that  are  consistent  with  the  data  at  aone 
time  but  that  employ  fundamentally  different  models  (e.g.,  enemy  attacks  at 
point  A  or  B  when  the  data  indicate  he  is  heading  near  both)  are  considered. 

In  fact*  most  cases  of  interest  involve  multiple  hypotheses  that  cannot  yet  be 
ruled  out  by  the  data  but  that  are  nonetheless  different. 

If  the  hypothesis  is  a  model  of  the  world*  and  we  wish  to  estimate  the 
states  of  the  model  and  the  probability  of  the  model's  being  true  given  noisy 
measurements  of  the  world,  we  are  led  to  consider  Kalman  filters  and  multiple 
hypothesis  testing  techniques  [6;30j .  The  strength  of  these  techniques  lies 
in  their  mathematical  foundations  and  adaptability*  and  both  are  ^sed  for  the 
hype thesis  evaluator  described  below.  We  are  encouraged  to  use  Kalman  filters 
in  this  context  by  their  successful  application  to  human  modeling  (in  simpler 
control  tasks)  in  the  work  of  [7;9]. 

The  overall  model  we  propose  for  the  hypothesis  evaluation  function  is 
shown  in  Fig.  3-3.  Data  are  passed  to  a  state-estimator  component  composed  of 
several  parallel  Kalman  filters  (one  for  each  hypothesis).  Each  Kalman  filter 
provides  two  key  outputs;  the  first  is  a  state  estimate  based  on  the  data. 


and  the  second  is  the  error  sequence*  6j.*  which  is  the  difference  between  the 
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Figure  3-3*  Rypotheai*  Evaluation 

measurements  end  the  filter's  prior  estimates  of  what  the  measurements  would 
be.  The  error  sequence  is  an  indication  of  how  well  the  data  match  the  fil¬ 
ter's  expectations,  and  thus  provides  key  information  about  how  the  data  sup¬ 
port  each  hypothesis.  Bach  error  eequence  is  input  to  a  likelihood  function 
calculator  that  computes  the  probability  of  a  data  sequence's  being  observed 
given  that  the  hypothesis  is  true.  This  function  ia  input,  in  turn,  to  Bayes 
theorem,  which  computes  the  desired  probability  p(BjJz)  of  the  hypothesis's 
being  true. 

3.3  COMPONENT  DESCRIPTIONS 

The  above  msdel  involves  much  parallel  processing  of  data:  parallel 
state  estimations;  likelihood  evaluations;  and  Bayes  calculations.  Such  pro¬ 
cessing  may  not  be  an  accurate  depiction  of  how  the  brain  functions,  but  it 
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does  mimic  how  a  commander  would  simultaneously  consider  several  hypotheses 
•bout  what  is  going  on,  examining  how  new  information  support  or  refute  each 
hypothesis. 

3.3.1  Mental  Model  Implied  by  a  Hypothesis 

A  conceptual  model  of  the  battlefield  is  shown  in  Pig.  3-4.  The  inputs 
to  the  world  consist  of  our  actions,  the  enemy's,  and  nature's.  These  ac¬ 
tions  cause  the  states  of  the  world  to  evolve,  which  in  turn  is  measured  by 
us  through  observations.  The  measurement  process  involves  only  some  of  the 
states. 
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Figure  3-4.  Input-Output  Model 

The  general  features  of  a  mental  model  are  captured  by  the  specific  lin¬ 
ear  system  shown  in  the  vector  block  diagram  of  Fig.  3-5.  The  state  of  the 
system  is  denoted  by  x,  the  output,  y,  observation,  s,  and  Inputs,  u  and  w. 

Of  these  vector  variables,  only  the  input,  u,  and  observation,  a,  are  avail¬ 
able  to  the  decisionmaker.  The  other  variables  represent  an  Internal  char¬ 
acterization  of  "the  way  things  work."  The  use  of  vectors  disguises  the  fact 
that  each  of  these  variables  can  include  many  separate  elements,  such  as  the 
positions  and  velocities  of  several  vehicles  in  three-dimensional  space.  The 
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•is*  of  these  vectors,  and  tharafora  tha  true  complexity  of  tha  nodal,  needs 
to  be  determined  for  each  application.  Tha  beauty  of  tha  mathematics  is  that 
tha  operations  can  be  described  in  tha  compact  vector-matrix  form,  independent 
of  tha  sisa  of  the  system. 


RANDOM 

PROCESS  - 

NOISE  m 

OUR  ACTIONS _ 

CONTROLS  .. 


MEASUREMENT 

NOISE 


STATES  x 


3 

OUTPUTS 


OBSERVATIONS 

> 


LECENO: 

u  -  CONTROLS 

A  •  MATRIX  REPRESENTING  SYSTEM  DYNAMICS 

«  *  STATES 

G  »  MATRIX  SHAPING  NOISE  INPUTS 

y  -  OUTPUTS 

1  «  MATRIX  SHAPING  INPUTS  (INPUT 

Z  -  MEASUREMENTS 

EFFECTIVENESS) 

w  -  PROCESS  NOISE 

C  •  OUTPUT  MATRIX 

n  -  MEASUREMENT  NOISE 

Figure  3-5.  Linear  System  Representation  of  a  Mental  Model 


This  model  represents  the  state  dynamics  as  a  linear  system,  with  possi¬ 
bly  time-varying  coefficients,  driven  by  the  decisionmaker's  actions  and  some 
uncontrolled  noise  or  disturbances,  and  observed  through  Imperfect  measure¬ 
ments.  The  transformation  matrix,  C,  represents  the  fact  that,  even  without 
noise,  the  entire  state  of  the  system  cannot  be  observed,  but  only  a  limited 
number  of  outputs.  The  state  is  the  current  Information  needed  to  predict 
the  future  system  outputs  when  combined  with  future  inputs.  It  summarizes  all 
important  current  facts  about  the  system. 
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The  parameters  of  the  model  are  contained  in  the  A,  B,  C,  and  G  transfor¬ 
mation  matrices  and  the  noise  covariance  matrices  Q,  for  the  process  noise  w, 
and  R,  for  the  measurement  noise  a.  The  noise  pi ocesses  represent  unknown 
inputs  to  the  system  and  measurement,  and  are  a  convenient  way  of  introducing 
uncertainty.  We  need  to  know  the  average  strength  of  these  processes,  but 
we  cannot  kuow  the  actual  values,  w  and  n.  In  the  standard  filter,  they  are 
represented  as  white,  i.e.,  flat  power  spectrum,  Gaussian  processes,  which  if 
integrated  would  result  in  Brownian  motions.  These  noises  are  useful  mathe¬ 
matical  fictions  that  introduce  input  and  output  uncertainty  into  the  system 
description,  and  result  in  a  well-behaved  state  estimator.  Such  noise  de¬ 
scriptions  are  reasonably  accurate  for  a  wide  variety  of  actual  noise  proces¬ 
ses,  and  the  parameter  values  are  not  usually  critical,  i.e.,  they  do  not  need 
to  be  known  precisely. 

The  model,  as  shown,  represents  a  continuous-time  system,  where  the  vari¬ 
ables  are  considered  to  be  processes  changing  with  time.  Kalman  filters  can 
also  be  created  for  discrete-time  systems,  where  the  processes  change  at  spe¬ 
cified  time  intervals.  Both  static  and  dynamic  C2  models  fit  into  either  of 
these  frameworks. 

3.3.2  Kalman  Filters  for  Linear  Process  Models 

Given  the  linear  model  above,  and  using  only  knowledge  of  u  and  z,  a 
Kalman  filter  is  a  device  for  optimally,  under  certain  assumptions,  estimating 

a 

the  state  of  the  system.  The  state  estimate  is  called  x,  and  the  probability 

A 

density  of  the  error  (x-x),  given  the  measurements,  is  a  Gaussian  density  with 

A 

zero  mean  and  covariance  P.  The  estimate  x  is  also  the  mean  of  the  state  con¬ 
ditioned  on  the  measurements  up  to  the  current  tire,  and  the  covariance  P  is 
the  conditional  covariance. 
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The  filter* 8  operation  is  characterised  in  Fig.  3-7.  The  filter  is  based 
on  a  model  of  the  system,  used  to  predict  the  system  output,  and  correcti  d  by 
the  Instantaneous  errors,  between  the  observation,  z,  and  the  filter's  pre- 

A 

diction  of  the  observation,  z. 


R-0507 


Figure  3-7.  Characterization  of  Filter  Operation 

Under  ideal  conditions,  the  error  process,  6,  called  the  innovations  or 
residuals,  is  a  white  Gaussian  process  resembling  the  measurement  noise. 
Intuitively,  if  the  filter's  errors  are  larger  than  predicted,  we  expect  that 
the  linear  model  is  wrong.  This  forms  the  basis  for  the  hypothesis  testing 
component  of  our  decision  model. 

3.3.3  Multiple  Hypothesis  Testing 


The  hypothesis  testing  component  of  the  decision  model  takes  the  input 
data  and  computes  the  posterior  probabilities  p(Hijz),  i.e.,  the  probability 
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that  each  hypothesis  is  true  given  the  data,  z.  The  calculation  of  these 
probabilities  uses  several  Kalman  filters  -  one  for  each  hypothesis.  The 
filter  relies  on  a  linear  model  and  parameter  set  (A^,  Bj_,  etc.)  and  computes 
a  best  linear  estimate  of  the  current  state  given  the  measurements .  The  hy¬ 
pothesis  tester  uses  the  innovations  from  each  Kalman  filter  to  compute  a  new 
probability  for  that  hypothesis’s  being  true. 

To  compute  the  posterior  probabilities  p(HjJz)  using  Bayes  theorem,  we 
need  the  probability 


p(*|Hi)  , 

called  the  likelihood  function.  For  the  linear  Gaussian  models  discussed 
earlier,  the  Important  result  we  will  need  is  that  the  natural  log  of  the 
likelihood  function,  called  €i(t),  "can  be  computed  recursively  essentially 
by  just  squaring  and  integrating  the  residuals  of  the  feedback  term  of  the 
optimal  filter  ..."  16,  p.  286].  Let  6i(t)  be  the  filter  residualc  (predic¬ 
tion  error)  and,  for  mathematical  simplicity  in  the  sequel,  assume  that  6j.(t) 
is  available  as  a  discrete-time  procesc ,  either  sampled  at  t«kA  from  a  con¬ 
tinuous  filter  or  available  directly  from  a  discrete  filter.  Let  M^(t)  be 
the  error  covariance  for  the  filter  at  time  t«kA  based  on  the  information 
(measurements)  up  to  time  (k-l)A,  i.e.,  the  one-step  ahead  prediction  error. 
Then  the  log-likelihood  function  can  be  computed  by  the  equation 

2?i(kA)  *>  Ci,bias(k6)  +  ?if  observation^A)  , 

where 


9 


5i,bias(kA) 


k  I"  Ri  - 

E  In  Mi(nA)  +  —  -  km  ln(2ir) 

n-i  L  A 
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where  m  le  the  dimension  of  s  end 


k  „  f  “O'1 

£i,observation(kA)  “  “  2  6^(nA)  I  M^(nA)  +  “  I  6i(nA)  . 

The  term  in  the  inverse  is  the  expected  covariance  of  the  process  if  the 
i-th  hypothesis  were  true;  thus  a  large  number  for  the  sum  will  occur  when  the 
6i's  are  large  (poor  filter  performance)  and  will  result  in  a  largely  negative 
5i, observation  and,  therefore,  a  small  likelihood  function,  since 

C/kA) 

■  * 


This  process  ie  shown  schematically  in  Fig.  3-8. 


FILTER 

PREDICTION 

ERRORS 

(kA) 


Figure  3-8.  Likelihood  Calculator 

In  the  above  calculator,  the  likelihood  function  represents  the  proba¬ 
bility  of  ?.  given  data  s(nA),  n-l,...,k,  i.e.,  occurring  given  that  the  1-th 


hypothesis  is  true.  The  diagram  indicates  how  this  function  is  updated  as 
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each  new  data  sample  arrives.  The  next  step  is  to  describe  how  the  posterior 
probabilities  p(Hi|zkA>  are  updated. 

This  update  is  nominally  accoaplished  using  Bayes  theorem,  which  simply 
states: 


P(*kdlHi)p(Hi) 

PO*i|*kA>  -  - 

P(*kA> 


p(Hj[)  is  the  a  priori  probability  of  the  hypothesis’s  being  true.  For  our 
purposes,  this  is  simply  the  same  as  the  probability  conditioned  on  data  up 
to  the  last  measurements,  p(Hi |*(k-l)A)*  normalizing  probability  p(zkA^ 

is  the  same  for  all  hypotheses  and  is  found  most  easily  from  the  fact  that 
the  sum  of  all  probabilities  is  1: 

I 

E  p(Hi|*kA>  -  1  • 

i-1 


Let 


1 

D  "  P<*kA>  “  *  P<*kAlHi>P<Hil*(k-l)A>  » 
i-1 


and ,  thus , 


P(*kAlHi)P(Hil*(k-l)A> 
P<Hil*kA>  -  - - - 


We  show  this  complete  process  schematically  in  Fig.  3-9 
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LIKELIHOOD  FUNCTIONS 


■  I  W  1W  *  I  «  bW 
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Figure  3-9.  Bayes  Theorem 

3.3.4  Summary  of  The  Modeling  Approach 

The  complete  hypothesis  evaluation  model  is  shown  in  Fig.  3-10.  For  each 
hypothesis,  there  is  a  Kalman  filter,  likelihood  function  calculator,  and  Bayes 
theorem  calculator,  which  needs  the  outputs  from  all  likelihood  function  cal¬ 
culations  for  normalization. 

In  many  cases,  the  models  for  the  different  hypotheses  will  be  similar, 
and  the  above  processing  can  be  simplified.  The  states  associated  with  in¬ 
controvertible  facts  (i.e.,  hypothesis-independent)  could  be  grouped  into  a 
single  "meta-model,"  and  the  state  estimates  from  the  corresponding  meta- 
filter  would  be  passed  on  to  the  option-evaluation  block.  The  error  from  this 
filter  would  not  provide  information  about  the  correctness  of  any  of  the  hy¬ 
potheses,  and  thus  would  not  be  passed  to  the  likelihood  function  or  Bayes 


Although  the  generation  and  number  of  hypotheses  are  determined  else¬ 
where,  the  case  when  only  one  hypothesis  is  considered  deserves  special  atten¬ 
tion.  If  one  hypothesis  is  considered,  the  normalization  in  Bayes  theorem 
results  in  a  unit  probability  for  that  hypothesis.  In  some  cases,  this  is  an 
accurate  model  of  human  behavior,  at  least  for  control  purposes  (l.e.,  the 
entire  SHOR  model  will  act  correctly  since  the  control  calculation  will  be 
based  on  the  only  hypothesis  considered).  At  other  times,  however,  a  decision¬ 
maker  might  have  j  one  ):v jocnesis  that  he  recognizes  might  be  wrong.  This 
behavior  can  be  modeled  in  two  ways.  The  first  is  to  consider  a  null  hypoth- 

A 

asls  (Hq)  corresponding  to  no  U’vs  estimate  (xo“0).  The  filter  for  this 
hypothesis  would  pass  residua.  (6)  equal  to  the  data  (z)  for  the  likelihood 

and  Bayes  calculations.  This  would  result  in  the  probability  for  his  one 
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hypothesis  (Hi)  being  reduced  (less  than  1)  since  P(Ho|z)  would  not  be  iden¬ 
tically  zero.  In  effect,  the  filter  errors  from  the  one  hypothesis  would  be 
compared  with  the  measurement  noise  alone. 

The  second  way  of  examining  a  single  hypothesis  is  to  evaluate  the  like¬ 
lihood  function  against  an  arbitrary  threshold,  where,  in  this  case  the  like¬ 
lihood  function  does  not  use  the  Bayes  theorem  normalization.  This  technique 
is,  in  fact,  with  suitable  choice  of  threshold,  similar  mathematically  to  the 
null  hypothesis  method,  since  the  division  in  Bayes  theorem  involves  two  like¬ 
lihood  functions.  In  general,  the  null  hypothesis  approach  is  recommended, 
but  only  after  determining  that  only  one  hypothesis  really  exists.  Often  the 
doubt  about  the  single  hypothesis  can  be  represented  as  a  second  hypothesis 
with  more  structure  than  the  null  concept  above.  The  added  structure  (beyond 

A 

x-0)  will  make  the  resulting  probaoility  calculations  much  more  accurate. 

3. A  ANTISUBMARINE  WARFARE  EXAMPLE 

This  subsection  illustrates  how  the  foregoing  hypothesis  evaluation  com¬ 
ponent  of  the  SHOR  model  might  apply  to  a  simplified  antisubmarine  warfare 
situation;  what  are  the  states,  measurements,  and  hypotheses,  and  how  do 
they  evolve?  The  example  considers  a  task  force  sailing  on  an  initial  course 
(North  in  the  following  figures)  during  an  "alert"  condition  resulting  from 
higher-level  intelligence.  The  task  force  commander*  believes  he  is  being 
shadowed  by  an  enemy  submarine  since  he  has  had  several  sonar  contacts  at  the 


♦The  functions  described  in  this  section  are  usually  carried  out  as  a  cooper¬ 
ative  effort  by  the  Composite  Warfare  Commander  (CWC)  and  the  ASWC.  We  shall 
UBe  the  term  task  force  commander  (TFC)  to  represent  this  joint  activity  and 
to  distinguish  it  from  actual  CWC/ASWC  doctrine  and  tactics,  which  it  is  not 
intended  to  represent. 
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trailing  adge  of  his  force,  although  none  were  confined.  The  situation  is 
illustrated  in  Fig.  3*11,  where  the  circle  represents  the  "keep-out"  range  of 
the  taak  force. 


Figure  3-11.  Initial  Conditions 
Initially,  the  TFC  considers  three  hypotheses. 


• 

Hq: 

There  is  no  enemy  submmarine. 

• 

Hi: 

There  is  an  eneay  submarine  trailing  the 

convoy,  but  he 

is  engaged  in  simple  harassment. 

• 

H2: 

There  is  a  trailing  submarine,  and  he  is 

preparing  for 

an  attack. 


*This  notation  is  used  to  denote  the  probability  that  H*  is  true  given  all  of 
the  data  up  to  an  including  measurements  at  time  0. 
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The  subjective  probabilities  the  coanander  places  on  these  hypotheses  at  time 
sero*  are: 


P(H<)|*0> 

-  0.45 

(nothing)  , 

p(Hi |*o) 

-  0.45 

(harassment)  , 

P(P2l*0> 

-  0.10 

(attack)  . 

(Exact  values  are  unimportant;  only  grossly  relative  weights  are  required). 

In  this  example,  the  times  denote  discrete  samples  approximately  10 
minutes  apart.  The  Kalman  filter  corresponding  to  each  hypothesis  predicts 
where  the  enemy  submarlne(s)  will  be,  with  time,  given  past  position  and 
velocity  measurements. 

At  time  1,  another  disappearing  sonar  contact  is  observed  from  the  area 
of  the  possible  trailing  submarine.  The  commander  updates  his  probabilities 
to  be: 

•  p(Hq|*i)  -  0.10  (nothing)  , 

a  p ( Hj | m i )  -  0.70  (harassment)  , 

•  p ( H2  |  ?. i )  ■  0.20  (attack)  . 

Based  on  these  probabilities,  he  orders  a  helicopter  to  investigate.  (The 
process  whereby  this  decision  is  made  is  a  subject  for  investigation  next 
year.  The  purpose  here  is  to  Illustrate  the  evolution  of  the  hypotheses  for 
a  given  scenario.) 

At  time  2,  there  is  a  second  Bonar  contact,  this  time  ahead  of  the  fleet 
and  about  30*  to  the  starboard.  The  first  helicopter  is  now  in  the  area  of 
the  first  (trailing)  contact,  but  cannot  find  anything.  The  commander  now 


*This  notation  is  used  to  denote  the  probability  that  %  is  true  given  all  of 
the  data  up  to  and  including  measurements  at  time  0. 
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recognise*  this  attack  pattern  from  war  game*.  He  reflnea  the  second  hypoth¬ 
esis  to  bet 

H2:  Task  force  under  specific  type  of  enemy  attack  . 


He  also  considers  that  both  sonar  contacts  could  be  reel*  but  that  the  enemy 
is  only  engaging  in  advanced  haiaataent .  He  considers  a  new  hypothesis: 

H3:  Two  submarines  present,  but  only  harassing  . 


He  ^pdates  the  probabilities  to  be 

e  p(Hq | *2)  »  0.05  (nothing)  , 

e  pO*i|*2)  ■  0.40  (shadow-harassment)  , 

e  p(H2 I *2)  ■  0.45  (attack)  , 

e  p(H3|*2)  •  0.10  (two-submarine  harassment) 


A  major  thrust  of  next  year's  effort  is  to  develop  the  option  evaluation 
component  of  the  decisionmaking  process.  For  this  example,  however,  one 
feasible  response  would  be  to  dispatch  the  escort  vessel  that  picked  up  the 
new  contact  to  investigate,  while  preparing  a  second  helicopter  for  launch. 

As  a  precaution,  he  might  order  the  task  force  to  change  direction.  The  situ¬ 
ation  is  shown  in  Fig.  3-12. 

At  this  point,  we  wish  to  demonstrate  how  the  data  can  Influence  the 
probabilities  placed  on  hypotheses,  and  the  resulting  effects  on  the  deci¬ 
sions,  by  examining  three  alternate  measurements  at  time  3. 


a 

p(H<)l*3a)  " 

(nothing)  , 

a 

p(Hj |*3»)  -  0.30 

(shadow)  , 

a 

P<H2l*3a>  ■  0*25 

(specific  attack)  , 

a 

p(H3!*3a)  -  0.05 

(two-submarine  harassment) 
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Figure  3-12.  Schematic  of  an  Evolving  ASW  Situation 
The  ASUC  decides  to  continue  on  the  altered  course.  If  he  finds  no  evi- 

i 

dence  of  either  submarine  soda,  he  will  resume  original  course,  discarding  B2 

.  »  .* 
and  H3. 

In  the  second  case  (3b),  the  new  contact  is  confirmed  by  the  escort 
vessel.  The  submarine  is  identified  as  an  enemy  type,  and  found  to  be  maneu¬ 
vering  for  a  possible  attack.  The  first  submarine  has  not  yet  been  confirmed 
and  a  fourth  hypothesis  is  added  to  consider  a  single  submarine  (from  ahead) 
attacking: 

H4:  single-submarine  forward  attack  . 


The  updated  probabilities  become: 
•  p(H<)|*3b)  "  °»00 


> 


(nothing) 
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• 

P<Hl|*3b> 

-  0.00 

( shadow)  , 

• 

P0*2l*3b) 

-  0.20 

(two-submarine  attack) 

• 

P<«3 l*3b> 

-  0.40 

(harassment)  , 

• 

P04|*3b> 

-  0.40 

(single-forward  attack) 

The  commander  decides  to  arm  hia  weapons  and  prepare  for  a  solo  attack  (H4). 

In  the  third  case,  both  submarines  are  confirned  and  observed  to  be 
maneuvering  for  an  attack.  The  probabilities  become: 


• 

P(«ol*3c) 

-  0.00 

(nothing)  , 

• 

PO*ll*3c> 

■  0.00 

(shadow)  , 

• 

p(H2 |*3C) 

-  0.60 

(two-submarine  attack) 

• 

P(»3l*3c) 

-  0.40 

(harassment)  . 

The  commander  decides  to  prepare  for  the  attack,  arming  weapons  and  possibly 
changing  course. 

In  these  cases,  we  see  how  data  can  force  a  modification  of  the  hypoth¬ 
eses,  greatly  influence  the  probabilities  associated  with  them,  and  thus 

V 

Influence  the  decisions  made.  The  role  of  Kalman  filtering  in  this  scenario 
is  almost  transparent  -  simply  predicting  the  expected  locations  of  the  sub¬ 
marines  assuming  the  last  sightings  were  real  targets.  In  more  complex  exam¬ 
ples,  we  expect  the  filters  to  play  a  more  important  role,  predicting  more 
subtle  (unobserved)  states,  and  therefore  possibly  motivating  new  measurements 
to  observe  those  states. 

3.5  NUMERICAL  EXAMPLE 

This  subsection  presents  a  simple  numerical  example  of  the  hypothesis 
evaluation  component  of  the  SHOR  model  to  demonstrate  how  the  system  parameters 
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affect  the  probability  estimates  and  their  variation  with  time.  The  example 
considers  two  hypotheses  and  a  simple  scalar  measurement. *  The  first  hypoth¬ 
esis  is  that  the  system  state  is  a  scalar  first-order  Gauss-Markov  process 
driven  by  white  Gaussian  noise,  and  observed  with  additive  white  Gaussian 
noise.  This  corresponds  to  an  exponential  autocorrelation  function  for  the 
state.  The  state  might  represent  the  increase  (or  decrease)  of  enemy  probes 
along  a  perimeter,  and  the  measurement  would  be  the  reported  increase  or  de¬ 
crease.  The  second  hypothesis  is  that  there  are  no  state  dynamics  (i.e., 
x-0) ,  only  measurement  noise  (i.e.,  false  reports  or  activity). 

The  continuous-time  model  for  the  first  hypothesis  (Hj),  using  the  nota¬ 
tion  of  subsection  3.3,  is  represented  by 

A  «-l  ;  G  -  1  ; 

B  -  1  ;  Q  -  1  ; 

C  -  1  ;  R  -  1  ; 

u  •  0  . 

This  system  is  shown  in  Fig.  3-13. 


V 

W _ _ J 

\  > 

_ z 

l 

- F-V  ^ 

R-0490 


Figure  3-13.  First  Hypothesis 


*The  general  modeling  approach  was  developed  for  arbitrarily  large  vector  mea¬ 
surements,  states,  and  inputs.  The  example  of  this  section  is  the  simplest, 
scalar  case. 
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The  second  hypothesis  has  the  parameter  set : 


A 

B 

C 

u 


0 

0 

0 

0 


G 

Q 

R 

x  -  0 


0  i 

o  ; 
1  ; 


This  system  is  shovm  in  Fig.  3-14. 


■*"0- 


R-0491 


Figure  3-14.  Second  Hypothesis 

The  discrete-time  version  of  these  systems,  which  has  generally  similar 
behavior  (for  short  sample  times  A),  is  given  by 

% 

Hi:  *k+l  “  (l-Ajxv.  +  Awfc  , 

*k  ■  *k  +  vk  J 
H2:  sk  ■  Vk  , 

otherwise  , 

(under  both  hypotheses)  and 


where 


E[vk  vj] 


R 

A 

0 
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E[wk  wj] 


Q 

A 

0 


J-fc  » 

otherwise  , 


under  Hi*  The  noises  are  independent  of  each  other. 

Our  hypothesis  evaluation  model  constructs  two  Kalman  filters  (one  for 
each  hypothesis),  given  by 

A  A  A 

Hl:  *k+l  “  (I'Ajxjt  +  AK(zfc  -  (1-A)*k)  , 

K  -  P/R  , 

A 

6k  -  zk  “  *k  » 

H2:  xfc  -  0  , 

6k  -  Zk  “  vfc  . 


Under  Hj,  the  gain  K  is  determined  from  the  conditional  covariance  P,  which 
satisfies  the  equation 


p~l 

k+1 


M-i  +  r  - 

k+l  L  A 


» 


Mfc+i  -  (l-A)2Pk  +  AQ  . 


For  (^>R-1,  and  for  A"0.1,  this  has  the  solution  (in  steady-state),  when 

Pk+1  -  Pk)«* 


P  -  0.426  , 


M  ■  0.445  . 
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P  denotes  the  conditional  covariance  just  after  a  measurement r  and  M  the  co- 
variance  just  before  a  measurement  (i.e.,  the  one-step  prediction  error).  For 
comparison,  the  continuous -time  variance  is  given  by 

P  -  ^2~ -  1  -  0.414  . 

» 

Thus,  little  information  is  lost  in  the  discrete  version  (A«0.1). 

We  next  want  to  examine  how  the  hypothesis  evaluation  takes  place  if  H} 
were  true.  Then  the  filter  above  is  optimal,  and  the  error  process  for  the 
first  filter  has  a  covariance  given  by 


E[fi2  |H  ] 

1 


R 

M  +  -  . 

A 


For  the  second  filter,  the  error  process  becomes 


«k  -  *k  +  Vk  . 


which  has  a  covariance  given  by 


e[52  !*  1-52+5  , 

3*2  1  A 

where  x2  is  the  covariance  of  the  actual  state,  found  from 

x2  “  P0Lk+1  "  U“4)2PoLk  +  A<5  * 

which  in  steady-state,  becomes 

x2  -  0.526  , 
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Using  the  processing  formulas  of  subsection  3.3,  and  assuming  that  the 
average  value  of  6^  is  approximated  by  the  expectations  above,  we  can  now  com¬ 
pute  the  posterior  probabilities  p(Hi|zk)  and  p(H2|zfc)  with  time  (as  the  mea¬ 
surements  are  taken).  In  any  experiment,  the  actual  values  of  the  error  se- 
uences  will  be  noisy,  and  the  probabilities  may  become  more  <.  r  less  accurate. 
But  on  the  average,  we  expect  them  to  behave  as  shown  in  Fig.  3-15.  The  fig¬ 
ure  depicts  the  first  30  samples  of  a  hypothesis  evaluation  (Hi  was  true)  that 
began  with  the  filters  in  steady-state,  that  is,  the  Initial  conditions  of  the 
covariances  were  equal  to  their  steady-state  values  so  that  no  gain  transients 
occurred,  and  with  three  Initial  probabilities  for  p(Hi|zo):  0.2i» ,  0.50,  and 
0.75.  In  all  cases  p(H2|z^)  is  simply 

pCil2  |  *k>  “  1  “  P(Hi|zk)  . 


Figure  3-15.  Posterior  Probability  Variation  with  Time  (H^  True) 
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He  see  that,  on  the  average,  the  correct  hypothesis  is  chosen  reasonably 
quickly,  unless  the  Initial  estimate  p(Hi|xq)  was  poor  or  the  number  of  sam¬ 
ples  small.  The  speed  of  response  of  the  probabilities  is  determined  by  the 
parameters  in  the  model,  through  the  covariances  and  initial  estimates,  and 
the  actual  noise  samples  (data)  received.  He  note  that  the  case  where  H2  Is 
true  produces  similar  (symmetric)  results  for  p(H2|sfc). 

3.6  SUMMARY 

This  section  has  presented  our  concept  of  an  expanded  SHOR  model  for 
human  decisionmaking  in  C3.  SHOR  was  decomposed  into  hypothesis  and  option 
evaluation  components,  connected  by  the  state  estimates  and  hypothesis  prob¬ 
abilities.  A  detailed  hypothesis  evaluation  model  was  then  designed  that  cap¬ 
tures  the  lmporant  human  behavior.  An  ASH  example  was  presented  to  illustrate 
the  overall  SHOR  approach,  and  a  simple  numerical  example  was  discussed  that 
demonstrated  how  the  hypothesis  evaluation  component  of  the  model  works. 
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SECTION  4 

DISCUSSION  AND  RECOMMENDATIONS  FOR  FUTURE  RESEARCH 

4.1  DISCUSSION 

Summary.  The  SHOR  paradigm  was  presented  as  a  structure  for  analysing 
human  cognitive  decisionmaking.  The  SHOR  paradigm  describes  decisionmaking 
as  a  cascading  of  four  activities.  They  are  information  processing,  hypoth¬ 
esis  generation  and  evaluation,  option  generation  and  evaluation,  and  decision 
execution. 

A  model  of  a  commander's  hypothesis  evaluation  activity  was  developed. 

The  model  was  cast  in  the  Bayesian  (optimal)  framework.  The  inputs  to  the 
model  are  the  hypotheses  and  sensor  data,  and  its  outputs  are  the  posterior 
probabilities  of  the  hypotheses '  being  true  and  their  respective  states  of 
nature.  It  has  been  tacitly  assumed  that  these  outputs  are  sufficient  for 
the  commander  to  perform  the  option  generation  and  evaluation  activities. 

A  brief  example  of  how  the  posterior  probabilities  of  the  hypotheses 
evolve  in  the  light  of  new  data  was  presented. 

Implications. 

1.  Based  on  previous  discussions,  data  are  received,  identified, 
and  Interpreted  to  have  Information  value  by  perception  pro¬ 
cessing.  The  reason,  then,  to  model  this  process  would  be  an 
attribution  of  importance  to  how  preliminary  data  are  inter¬ 
preted  to  later  modeling  efforts,  such  as  decisionmaking  or 
selection.  In  the  ASWC  context,  sensor  data  or  intelligence 
information  are  generally  presented  to  commanders  in  an  unam¬ 
biguous  manner  -  though  it  is  often  uncertain  in  nature.  Such 
umambiguity  precludes  the  role  of  perception  processing  in  the 
modeling  effort. 
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2.  In  the  context  of  ASW,  hypotheses  ere  the  existence  or  nonexis¬ 
tence  of  tsrget  tracks  and  the  target's  classifications.  All 
targets  ere  presumed  hostile. 

3.  The  Bayesian  hypothesis  evaluation  technique  described  must  be 
revised  to  include  human  limitations  and  biases.  It  is  improb¬ 
able  that  commanders  have  the  cognitive  capacity  to  grapple 
with  the  combinatorial  complexity  requisite  for  the  solution  of 
this  algorithm.  Nor  is  there  any  evidence  that  they  do  it  in 
this  way. 

4.  The  depth  first,  one-step  backtrack  option  evaluation  algorithm 
[31]  is  not  suitable.  We  have  learned  from  conversations  with 
ASW  commanders  that  they  do  not  optimise.  They  satisfice  [32], 
i.e.,  they  meet  some  predetermined  requirements  for  action. 

One  commander  described  the  option  evaluation  activity  as 
"selecting  the  first  feasible  action."  Some  commanders  simply 
adhere  to  standard  operating  procedures  or  doctrine. 


4.2  RECOMMENDATIONS  FOR  FUTURE  RESEARCH 

Next  year' 8  effort  will  involve  the  development  of  a  computer  simulation 
of  an  ASW  battle  group  commander  in  a  hostile  environment.  The  decision  prob¬ 
lem  will  be  as  follows.  The  ASW  commander  trill  be  responsible  for  the  track¬ 
ing,  localization,  and  prosecution  of  all  subsurface  contacts  to  preclude  the 
enemy  from  coming  within  range  to  launch  torpedoes  or  cruise  missiles  against 
the  carrier.  The  ASWC  will  have  at  his  disposal  sensors  and  weapons.  These 
sensors  and  weapons  are  components  of,  or  contained  on,  the  battle  group's 
destroyers,  attack  submarine,  helicopters,  and  carrier-based  aircraft. 

The  seminal  activity  of  the  ASWC  will  then  be  situation  assessment.  On 
a  continuous  basis,  he  is  asking  and  trying  to  clarify  these  questions  [1]: 

•  Is  the  datum  a  false  alarm? 

•  If  not,  is  it  an  old  or  new  target? 

•  How  can  I  resolve  these  ambiguities? 

•  Which  sensorCs)  and  where  to  deploy? 
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•  Am  I  rendering  the  carrier  vulnerable  to  attack  by  an,  as  yet 
undetected  enemy  submarine? 

The  model  of  the  ASWC's  decision  process  will  have  three  major 


subroutines. 


Truth  subroutine.  This  subroutine  will  model  the  motion  of  the  battle 
group's  platforms,  the  status  of  their  set.sors,  and  the  motion  of  the  enemy 
submarines.  The  inputs  to  the  subroutine  will  be  the  ASWC's  decisions,  over¬ 
all  battle  group  line  of  intended  movement,  and  enemy  submarine  trajectories. 
The  outputs  will  be  the  new  battle  group  locetions  and  the  data  (contacts) 
generated  by  the  operational  sensors. 


Tracking  subroutine.  This  subroutine  will  model  the  hypothesis  evalua¬ 
tion,  or  situation  assessment,  activity.  That  is,  sensor  data  will  be  related 
to  target  tracks.  The  inputs  to  the  subroutine  will  be  the  sensor  data  and 
battle  group  state  estimates.  The  outputs  will  be  the  state  estimates  of  the 
tracks  and  their  posterior  probabilities  of  being  true  tracks.  This  sub¬ 
routine  will  build  upon  the  work  presented  in  Section  3. 

Decision  subroutine.  The  commander's  decisionmaking  algorithm  will  be 
modeled  in  this  subroutine.  His  controls  include  the  motion  and  responsibil¬ 
ity  of  ASW  platforms.  More  specifically,  he  directs  the  platform  movement  in 
space,  and  platform  sensor  and  weapon  status.  His  decisions  will  be  made  on 
the  basis  of  the  perceived  threat  of  the  target  and  the  cost  (increased  vul¬ 
nerability)  of  deploying  an  asset  to  gather  more  information.  The  Inputs  to 
the  subroutine  will  be  the  state  estimates  of  the  tracks,  the  posterior  proba¬ 
bilities  of  being  true  tracks,  and  the  state  estimates  of  the  battle  group. 
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The  outputs  will  be  the  platform  coanands.  The  decision  subroutine  will  en¬ 
code  the  satisficing  or  bounded  rationality  nature  of  ASW  decisionmaking. 

Interviews  with  experienced  ASW  players  will  be  held  to  assess  the  rea¬ 
sonableness  of  the  model. 
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